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Related Application 
This application is a continuation-in-part application of U.S. application 
number, 09/732,522, filed December 6, 2000, entitled "System and Method for 
5 Intracoding Video Data". 

This application also claims priority to Provisional Applications: 

a) number 60/394,524, filed July 8, 2002, entitled "Low Complexity 
.Diagonal Mode for intra-Prediction"; 

b) number 60/414,210, filed September 27, 2002, entitled "Reducing 
1 0 Pixel Dependencies for Intra Prediction"; 

c) number 60/41 5,447, filed October 1 , 2002, entitled "Reducing Pixel 
Dependencies for Intra Prediction With Varying Block Sizes". 

The specifications of these applications are hereby fully incorporated by 
reference. 

15 Background of the Invention 

Field of the Invention 

The invention pertains to a video system that compresses video data for 
transmission or storage and decompresses the video data for display. More 
particularly, the invention pertains to a video system and a method for intracoding 
20 video data. 

Description of the Related Art 

Video systems transmit, process and store large quantities of video data. To 
create a video presentation, such as a video movie, a rendering video system 
displays the video data as a plurality of digital images, also referred to as "frames," 

25 thereby simulating movement In order to achieve a video presentation with an 

acceptable video quality, or to enable transmission and storage at all, a conventional 
video system modifies the video data prior to transmission or storage. For instance, 
the video system compresses and encodes the video data to reduce the bit rate for 
storage and transmission. 

30 In a conventional video system a video encoder is used to compress and 

encode the video data and a video decoder is used to decompress and to decode 
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the video data. The video encoder outputs video data that has a reduced bit rate 
and a reduced redundancy. That is, the technique of video compression removes 
spatial redundancy within a video frame or temporal redundancy between 
consecutive video frames. 
5 The video encoder and video decoder may be configured to apply one of two 

types of coding to compress the video stream, namely intracoding and intercoding. 
These two types of coding are based on the statistical properties of the video frames. 
When the video frames are coded using intracoding, the compression is based on 
information contained in a single frame (the frame that is compressed) by using the 

10 spatial redundancy within the frame. Intracoding, thus, does not depend on any 
other frames. In contrast, intercoding uses at least one other frame as a reference 
and codes a difference between the frame to be compressed and the reference 
frame. Intercoding is thus based on a temporal redundancy between consecutive 
frames in the video data. 

15 The field of video compression is subject to international standards, e.g., 

various International Telecommunications Union (ITU) standards that define uniform 
requirements for video coding and decoding. Typically, these standards evolve 
based on contributions from the industry. In addition, manufacturers of video coders 
and decoders also modify or build upon the international standards and implement 

20 additional proprietary techniques for video compression. 

Despite the existence of the international standards and the proprietary 
techniques, there is still a need for improved techniques for video compression. For 
example, as the quality of a displayed video movie depends directly from the 
technique used for video compression, any improvement of the video compression 

25 technique makes the video movie more pleasing for the viewer. 

Brief Description of the Drawings 
These and other aspects, advantages, and novel features of the invention will 
become apparent upon reading the following detailed description and upon reference 
to the accompanying drawings. 

30 Figure 1 is a high-level block diagram of a system for video applications 

having an encoding side and a decoding side. 
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Figure 2 is a high-level illustration of a frame and its division in macroblocks 
and subblocks. 

Figure 3 is a subblock illustrating the directions according to which the 
subblock can be encoded, wherein each direction represents one of eight prediction 
5 modes in accordance with the present invention. 

Figure 4 is a flow chart in accordance with an embodiment of the present 
invention that selects a prediction mode. 

Figure 5 is an illustration of three neighboring subbiocks, wherein two 
subblocks are used to encode the third subblock. 
10 Figure 6 illustrates a video device having an encoder and a decoder 

incorporated with the encoding/decoding teachings of the present invention, in 
accordance with one embodiment. 

Figure 7 illustrates an article of manufacture with a recordable medium 
having a software implementation of the encoder/decoder of the present invention, 
15 designed for use to program a device to equip the device with the encoding/decoding 
capability of the present invention, in accordance with one embodiment. 

Figure 8 illustrates a system having a video sender device and a video 
receiver device incorporated with the encoding/decoding teachings of the present 
invention, in accordance with one embodiment. 
20 Figures 9a-9c illustrate the surrounding pixels used for predicting the pixel 

values of a 8x8, a 8x4 and a 4x8 subblock respectively, in accordance to three 
alternate embodiments. 

Detailed Description of the Preferred Embodiment 
In the following description, reference is made to the accompanying drawings, 
25 which form a part hereof, and which show, by way of illustration, specific 

embodiments in which the invention may be practiced. It is to be understood that 
other embodiments may be utilized and structural changes may be made without 
departing from the scope of the present invention. Where possible, the same 
reference numbers will be used throughout the drawings to refer to the same or like 
30 components. Numerous specific details are set forth in order to provide a thorough 
understanding of the present invention. However, it will be obvious to one skilled in 
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the art that the present invention may be practiced without the specific details or with 
certain alternative equivalent devices and methods to those described herein. In 
other instances, well-known methods, procedures, components, and devices have 
not been described in detail so as not to unnecessarily obscure aspects of the 
5 present invention. 

Various operations will be described as multiple discrete steps in turn, in a 
manner that is helpful in understanding the present invention, however, the order of 
description should not be construed as to impiy that these operations are necessarily 
order dependent. In particular, these operations need not be performed in the order 

10 of presentation. 

The phrase "in one embodiment" is used repeatedly. The phrase generally 
does not refer to the same embodiment, however, it may. The terms "comprising", 
"having" and "including" are synonymous, unless the context dictates otherwise. 

Figure 1 is a high-level block diagram of a video compression and 

15 decompression system 1 (hereinafter "video system 1") having an encoder 
apparatus 3 and a decoder apparatus 5 that is coupled to the encoder apparatus 3 
through a medium 9. The encoder apparatus 3 includes a video encoder 2, a mode 
selector 14 and a buffer 8. The decoder apparatus 5 includes a buffer 10, a video 
decoder 12 and a mode selector 16. The encoder apparatus 3 receives a video 

20 sequence 20 (VIDEO IN) and encodes the video sequence 20 to generate an 
encoded and thus compressed representation in one of a number of possible 
formats. The format may be in an interleaved format tailored for "live" streaming of 
the encoded representation. The format may also be in a single file format in which 
each of the encoded representation is stored in a contiguous block within one file. 

25 The video sequence 20 input to the encoder apparatus 3 may be either a live 

signal, e.g., provided by a video camera, or a prerecorded sequence in a 
predetermined format. The video sequence 20 includes frames of a digital video, an 
audio segment consisting of digital audio, combinations of video, graphics, text, 
and/or a udio ( multimedia a pplications), o r a nalog forms of the aforementioned. If 

30 necessary, conversions can be applied to various types of input signals such as 
analog video, or previously compressed and encoded video to produce an 
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appropriate input to the encoder apparatus 3. In one embodiment, the encoder 
apparatus 3 may accept video in RGB or YUV formats. The encoder apparatus 3, 
however, may be adapted to accept any format of input as long as an appropriate 
conversion mechanism is supplied. Conversion mechanisms for converting a signal 
5 in one format to a signal in another format are well known in the art. 

The medium 9 may be a storage device or a transmission medium. In one 
embodiment, the video system 1 may be implemented on a computer. The encoder 
apparatus 3 sends an encoded video stream (representation) to the medium S that is 
implemented as a storage device. The storage device may be a video server, a hard 

10 disk drive, a CD rewriteable drive, a read/write DVD drive, or any other device 
capable of storing and allowing the retrieval of encoded video data. T he storage 
device is connected to the decoder apparatus 5, which can selectively read from the 
storage device and decode the encoded video sequence. As the decoder apparatus 
5 decodes a selected one of the encoded video sequence, it generates a 

15 reproduction of the video sequence 20, for example, for display on a computer 
monitor or screen. 

In another embodiment, the medium 9 provides a connection to another 
computer, which may be a remote computer that receives the encoded video 
sequence. The medium 9 may be a network connection such as a LAN, a WAN, the 

20 Internet, or the like. The decoder apparatus 5 within the remote computer decodes 
the encoded representations contained therein and may generate a reproduction of 
the video sequence 20 on a screen or a monitor of the remote computer. 

Aspects of the video system 1 illustrated in Figure 1 and described above can 
be combined and supplemented to achieve other embodiments. Numerous other 

25 implementations are consistent with the scope of this invention. Such other 
implementations need not be restricted to video, but may include audio or other 
forms of media as well. 

Pre-existing video encoding techniques typically break up a frame (picture) 
into smaller blocks of pixels called macroblocks. Each macroblock can consist of a 

30 matrix of pixels, typically a 1 6x1 6 matrix, defining the unit of information at which 
encoding is performed. The matrix of pixels is therefore referred to as a 16x16 



-5- 



WO 2004/006587 PCTYUS2003/0 18963 



macroblock. These video encoding techniques usually break each 16x16 
macroblock further up into smaller matrices of pixels, e.g. 8x8 matrices of pixels or 
4x4 matrices of pixels. Such matrices are hereinafter referred to as subblocks. 

In one embodiment of the present invention, a 16x16 macroblock is divided 
5 into 16 4x4 subblocks. In other embodiments, a 16x16 marcoblock is divided into 
8x8 subblocks, 8x4 subblocks, or 4x8 subblocks. Those skilled in the art will 
appreciate that the present invention is equally applicable or easily adaptable to 
systems that use other sublocks, or only 16x16 marcobiocks without breaking it up 
into subblocks. 

10 Further, the pre-existing encoding techniques provide for motion 

compensation and motion estimation using motion vectors. The motion vectors 
describe the direction, expressed through an x-component and a y-component, and 
the amount of motion of the 16x16 macroblocks, or their respective subblocks, and 
are transmitted to the decoder as part of the bit stream. Motion vectors are used for 

15 bidirectionally encoded pictures (B-pictures) and predicted pictures (P pictures) as 
known in the art. 

The video encoder 2 performs a discrete cosine transform (DCT) to encode 
and compress the video sequence 20. Briefly, the video encoder 2 converts the 
video s equence 2 0 from the spacial, temporal domain into the frequency domain. 

20 The output of the video encoder 2 is a set of signal amplitudes, called "DCT 
coefficients." A quantizer receives the DCT coefficients and assigns each of a range 
(or step size) of DCT coefficient values a single value, such as a small integer, 
during encoding. Quantization allows data to be represented more compactly, but 
results in the loss of some data. Quantization on a finer scale results in a less 

25 compact representation (higher bit-rate), but also involves the loss of less data. 
Quantization on a more coarse scale results in a more compact representation 
(lower bit-rate), but also involves more loss of data. The mode selector 14 
communicates with the video encoder 2 and monitors and controls encoding of the 
video sequence 20. The mode selector 14 determines in accordance with the 

30 present invention prediction modes according to which the video encoder 2 encodes 
the video sequence 20. The mode selector 14 may be a processor or one or more 
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software modules that are configured to operate in accordance with a method of the 
present invention. Figure 1 shows the mode selector 14 for illustrative purposes as 
an element separate from the video encoder 2. Those skilled in the art will 
appreciate that the functionality of the mode selector 14 may be combined with the 
5 functionality of the video encoder 2. 

The buffer 8 of the encoder apparatus 3 receives the encoded and 
compressed video sequence (hereinafter "encoded video sequence") from the video 
encoder 2 and adjusts the bit rate of the encoded video sequence before it is sent to 
the medium 9. Buffering may be required because individual video images may 

10 contain varying amounts of information, resulting in varying coding efficiencies from 
image to image. As the buffer 8 has a limited size, a feedback loop to the quantizer 
may be used to avoid overflow or underflow of the buffer 8. The bit-rate of the 
representation is the rate at which the representation data must be processed in 
order to present the representation in real time. 

1 5 The decoder apparatus 5 performs the inverse function of the encoder 

apparatus 3. The buffer 10 serves also to adjust the bit rate of the incoming 
encoded video sequence. The video decoder 12 decodes and decompresses in 
combination with the mode selector 16 the incoming video sequence reconstructing 
the video sequence. The mode selector 16 determines the prediction modes 

20 according to which the video encoder 2 encoded the incoming video sequence. The 
decoder apparatus 5 outputs a decoded and decompressed video sequence 24 
illustrated as 'VIDEO OUT" (hereinafter "decoded video sequence 24"). 

The video decoder 12 receives a bit stream that represents the encoded video 
sequence from the buffer 10 (Figure 1). In one embodiment, the video decoder is a 

25 conventional video decoder, e.g., a MPEG-x decoder, that includes a decoder 
controller, a VLC decoder (Variable Length Coding, VLC) and a reconstruction 
module. The operation and function of these components are known to those skilled 
in the art. These components are known to those skilled in the art and described in 
generally available MPEG documents and publications. 

30 Figure 2 is a diagram illustrating a video frame 30 that is part of the video 

sequence 20. As described above, known video encoding techniques typically break 
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up a video frame 30 into macroblocks 36, 36a, 36b, 36c, 36d. For example, the 
video frame 30 is divided into a matrix of 16x16 macroblocks 36, 36a, 36b, 36c, 36d. 
The video system 1 encodes the macroblocks 36, 36a, 36b, 36c, 36d line by line, 
from top to bottom and from left to right, as indicated through a dashed line 34 that 

5 illustrates the sequence of, e.g., intra encoding. In the illustrated embodiment, the 
dashed line 34 ends at the macroblock 36a, which is the next macroblockto be 
encoded. All prior macroblocks 36, 36b, 36c, 36d have already been encoded. 

The macroblock 36a, as a representative for ail macroblocks 36, 36a, 36b, 
36c, 36d, is shown in greater detail below the video frame 30. The video encoding 

1 0 technique of the video system 1 breaks each macroblock 36, 36a, 36b, 36c, 36d 
further up into a matrix of pixels 38, hereinafter referred to as a subblock 38. 

In one embodiment, the subblock 38 is a 4x4 matrix of pixels, wherein the 16 
pixels are labeled as a, b, c, p (in a "row first" manner). Bordering pixels of an 
adjacent subblock of a neighboring macroblock 36b, which is located directly above 

15 subblock 38 of macroblock 36a, are labeled as A, B, C, D. Further, bordering pixels 
of a subblock of macroblock 36b located above and to the right of the subblock 38 
are labeled as E, F, G, H. Likewise, bordering pixels of an adjacent subblock of a 
neighboring macroblock 36c, which is located directly to the left of subblock 38 of 
macroblock 36a, are labeled as I, J, K, L. Bordering pixels of a subblock of 

20 marcoblock 36c located to the left and below of subblock 38 are labeled as M, N, O, 
P. A bordering pixel of a subblock of a macroblock 36d, which is located above and 
to the left of subblock 38 of the macroblock 36a, is labeled as Q. 

The video system 1 of the present invention codes each macroblock 36 as an 
intra macroblock. Intra macroblocks are transform encoded without motion 

25 compensated prediction. Thus, intra macroblocks do not reference decoded data 
from either previous or subsequent frames. An l-frame is a frame consisting 
completely of intra macroblocks. Thus, l-frames are encoded with no reference to 
previous or subsequent frames, l-frames are also known as "Intra-frames." 

Figure 3 is a subblock 38 illustrating possible directions according to which 

30 the subblock 38 may be encoded. In accordance with the present invention, the 
subblocks of a macroblock 36, 36a, 36b, 36c, 36d can be intra coded in one of nine 
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modes (Modes 0, Mode 1, Mode 9) as listed hereinafter. That is, a particular 
subblock 38 may be predicted from a subblock above the current subblock that is 
currently decoded ("vertical prediction"), from the subblock to the left of the current 
subblock ("horizontal prediction"), or from both the left and the above subblocks 
5 ("diagonal prediction"). The Modes 1-8 predict the subblock in a predetermined 
direction and the Mode 0 uses a uniform average without prediction in a 
predetermined direction. In Figure 3, each direction represents one of the eight 
prediction modes in accordance with the present invention. 
Mode 0: 

10 In this mode, each pixel a - p is predicted by the following equation: 

- , A + B + C + D + I + J + K + L + 4 

a, b, c, p = . 

o 

It is contemplated that in this mode as well as in the following modes, a 
"division" means to round the result down toward "minus infinity" (-°°). For instance, 
15 in mode 0, the term "+4" ensures that the division results in a rounding to the nearest 
integer. This applies also the other modes. 

If four of the pixels a - p are outside the current picture (frame) that is currently 
encoded, the average of the remaining four pixels is used for prediction. If all eight 
pixels are outside the picture, the prediction for ail pixels in this subblock is 128. A 
20 subblock may therefore always be predicted in mode 0. 

Mode 1: 

If the pixels A, B, C, D are inside the current picture, the pixels a - p are 
predicted in vertical direction as shown in Figure 3. That is, the pixels a-p are 
predicted as follows: 
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25 Mode 2: 
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If the pixels I, J, K, L are inside the current picture, the pixels a - p are 
predicted in horizontal direction. That is, the pixels a-p are predicted as follows: 



a, b, c, d 
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Mode 3: 

This mode is used if all pixels a - p are inside the current picture. This 
5 corresponds to a prediction in a diagonal direction as shown in Figure 3. The pixels 
a-p are predicted as follows: 
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Mode 4: 

This mode is used if all pixels a-p are inside the current picture. This is also 
a diagonal prediction. 
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10 Mode 5: 
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This mode is used if all pixels a - p are inside the current picture. This is also 
a diagonal prediction. 
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Mode 6: 

This mode is used if all pixels a - p are inside the current picture. This is a 
diagonal prediction. 
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Mode 7: 

This mode is used if all pixels a - p are inside the current picture. This is a 
diagonal prediction. 
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Mode 8: 

This mode is used if all pixels a - p are inside the current picture. This is a 
diagonal prediction. 
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5 In one embodiment of the present invention, a mode selection algorithm 

determines a criteria to select one of the nine modes. The subblock 38 is then 
encoded in accordance with the selected mode. The mode selection algorithm is 
described in detail below. 

Figure 4 is a flow chart of a procedure illustrating the method in accordance 
10 with the present invention that codes video data including a stream of video frames 
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and that selects one of the prediction modes Modes 0-8. In one embodiment, the 
method codes a luminance portion (Y) of a video frame. 

In a step 28, e.g., when a user activates the video system 1, the procedure 
initializes the video system 1. The initialization procedure includes, for example, 
5 determining whether the encoder apparatus 3 is operating and properly connected to 
receive the stream of video frames. 

In a step 30, the procedure receives the stream of video frames and divides 
each video frame into a matrix of a plurality of subbiocks, wherein each subblock 
includes a plurality of pixels. The matrix of a plurality of subbiocks may include 4x4 

10 subbiocks 38 that are part of a macroblock as described above. 

In a step 32, the procedure defines the nine prediction modes Mode 0-8, 
wherein each prediction mode determines a mode according to which a present 
subblock is to be coded. For example, the procedure may execute a subroutine to 
calculate and define the modes Mode 0-8. 

15 In a step 34, the procedure selects one of the nine prediction modes Mode 0- 

8 to encode the present subblock 38. In one embodiment, the procedure calculates 
for each mode an error value, determines which mode provides a minimum error 
value and selects that mode for encoding the present subblock 38. 

Once the procedure has selected the "best" prediction mode to encode the 

20 pixels of the present subblock 38, the procedure encodes the minimum error value 
and transmits the encoded minimum error value within a compressed bitstream to 
the decoder. The minimum error value represents a difference between the 
predicted pixels of the present subblock and the original pixels of the subblock. The 
difference may be encoded using a DCT, coefficient quantization and variable length 

25 coding as known in the art. The decoder uses the predicted pixels and the 
difference to the original pixels to accurately reconstruct the video frame. The 
procedure ends at a step 36. 

The procedure provides that each of the 4x4 subbiocks 38 is coded in 
accordance with one of the nine prediction modes Mode 0-8. As this may require a 

30 considerable number of bits if coded directly, the video system 1 in accordance with 
the present invention may apply a more efficient way of coding the mode information. 
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A prediction mode of a subblock is correlated with the prediction modes of adjacent 
subblocks. 

Figure 5 illustrates this through three exemplary subblocks A, B, C. The 
subblock C is the subblock that is to be encoded (predicted) with the help of the 
5 subblocks A, B whose prediction modes are known. The subblock A is located 
above the subblock C and the subblock B is located left of the subblock C. In this 
case, an ordering of the most probable, next most probable etc. prediction mode for 
the subblock C is given. An example of such an ordering tabie is listed hereinafter. 
The table is divided into ten groups (Group 1 -Group 10). In each group, the 
1 0 respective prediction mode for the subblock A is constant (e.g., Mode 0 of the 
subblock A is constant in Group 2), and the prediction mode for the subblock B 
varies. That is, the (constant) prediction mode for the subblock A within a group may 
be combined with one of the nine prediction modes for the subblock B within that 
group. 

15 F or each combination of the prediction modes of the subblocks A and B, a 

sequence of nine numbers is given, one number for each of the nine Modes 0-9. For 
example in Group 3, if the prediction modes for the subblock A and the subblock B 
are both Mode 1 , a string "1 6 2 5 3 0 4 8 7" indicates that the Mode 1 , i.e., the first 
number in the string, is the most probable mode for the subblock C. The Mode 6, 

20 i.e., the second number in the string, is the next most probable mode. In the 

exemplary string, the Mode 7 is the least probable since the number 7 is the last 
number in the string. The string will be part of the stream of bits that represents the 
encoded video sequence. 

The stream of bits therefore includes information (ProbO = 1 (see Table 1 )) 

25 indicating the mode used for the subblock C. For example, the information may 

indicate that the next most probable intra prediction mode is Mode 6. Note that a "-" 
in the table indicates that this instance cannot occur. The term "outside" used in the 
Table 1 indicates "outside the frame." If the subblock A or B is within the frame, but 
is not INTRA coded (e.g., in a P frame, the subblock C could be INTRA coded but 

30 either the subblock A or the subblock B may not be INTRA coded), there is no 
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prediction mode. The procedure of the present invention assumes the Mode 0 for 
such subblocks. 
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208 137546 


GROUP 4 


mode 4 


204 17863 5 




mode 5 


201584673 




mode 6 


206 147853 




mode 7 


278 105463 




mode 8 


2 87 1043 65 






B 


A = mode 3 




outside 






mode 0 


02 13 5 8647 




mode 1 


1 02536487 




mode 2 


28 1035764 




mode 3 


3258 14670 


GROUP 5 


mode 4 


4206 15837 




mode 5 


531286407 




mode 6 


1 60245837 




mode 7 


270 1 54863 
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mode 8 


283 5 10764 






B 


A = mode 4 




outside 






mode 0 


206147583 




mode 1 


162045378 




mode 2 


2876401 53 




mode 3 


421068357 


GROUP 6 


mode 4 


426015783 




mode 5 


125063478 




mode 6 


640127538 




mode 7 


274601 853 




mode 8 


287461 350 






B 


A = mode 5 




outside 






mode 0 


5 12368047 




mode 1 


156320487 




mode 2 


215368740 




mode 3 


531268470 


GROUP 7 


mode 4 


1 62458037 




mode 5 


5 1 3620847 




mode 6 


165204378 




mode 7 


271650834 




mode 8 


25 1368407 






B 


A = mode 6 




outside 






mode 0 


1 62054378 




mode 1 


165423078 
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mode 2 


216748530 




mode 3 


216584307 


GROUP 8 


mode 4 


641205783 




mode 5 


165230487 




mode 6 


6 1402753 8 




mode 7 


2746 15083 




mode 8 


216847350 






B 


A = mode 7 




outside 






mode 0 


204761853 




mode 1 


612047583 




mode 2 


278016435 




mode 3 


2408 3 1765 


GROUP 9 


mode 4 


427061 853 




mode 5 


210856743 




mode 6 


264 1705 83 




mode 7 


274086 153 




mode 8 


287410365 






B 


A = mode 8 




outside 






mode 0 


208 134657 




mode 1 


120685734 




mode 2 


287103654 




mode 3 


8325 10476 


GROUP 10 


mode 4 


20485 1763 




mode 5 


210853647 




mode 6 


2 160845 73 




mode 7 


278406 153 
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mode 8 


283074165 




Table 1 





The information about the prediction modes may be efficiently coded by 
combining prediction mode information of two subblocks 38 in one codeword. The 
stream of bits includes then the resulting codewords, wherein each codeword 
5 represents the prediction modes of the two subblocks. Table 2 lists exemplary 
binary codewords for code numbers (Code No.) between 0 and 80. The probability 
of a mode of the first subblock is indicated as ProbO and the probability of a mode of 
the second subblock is indicated as Probl. 



Code No. 


ProbO 


Probl 


Codeword 


0 


0 


0 


1 


1 


0 


1 


001 


2 


1 


0 


011 


3 


1 


1 


00001 


4 


0 


2 


00011 


5 


2 


0 


01001 


6 


0 


3 


01011 


7 


3 


0 


0000001 


8 


1 


2 


0000011 


9 


2 


1 


0001001 


10 


0 


4 


0001011 


11 


4 


0 


0100001 


12 


3 


1 


0100011 


13 


1 


3 


0101001 


14 


0 


5 


0101011 


15 


5 


0 


000000001 


16 


2 


2 


000000011 


17 


1 


4 


000001001 


18 


4 


1 


000001011 
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Code No. 


ProbO 


Probl 


Codeword 


19 


0 


6 


000100001 


20 


3 


2 


000100011 


21 


1 


5 


000101001 


22 


2 


3 


000101011 


23 


5 


1 


010000001 


24 


6 


0 


010000011 


25 


0 


7 


010001001 


26 


4 


2 


010001011 


27 


2 


4 


010100001 


28 


3 


3 


010100011 


29 


6 


1 


010101001 


30 


1 


6 


010101011 


31 


7 


0 


00000000001 


32 


0 


8 


00000000011 


33 


5 


2 


00000001001 


34 


4 


3 


00000001011 


35 


2 


5 


00000100001 


36 


3 


4 


00000100011 


37 


1 


7 


00000101001 


38 


4 


4 


00000101011 


39 


7 


1 


00010000001 


40 


8 


0 


00010000011 


41 


6 


2 


00010001001 


42 


3 


5 


00010001011 


43 


5 


3 


00010100001 


44 


2 


6 


00010100011 


45 


1 


8 


00010101001 


46 


2 


7 


00010101011 


47 


7 


2 


01000000001 
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uode JNo. 


ProbO 


Probl 


Codeword 


45 


o 
O 


1 


01000000011 


4y 


5 


4 


01000001001 




4 


5 


01000001011 


c 1 


3 


6 


01000100001 




6 


3 


01000100011 


53 


o 

8 


2 


01000101001 


C /I 

54 


4 


6 


01000101011 


55 


5 


5 


01010000001 


C/C 

56 


6 


A 

4 


01010000011 


57 


2 


8 


01010001001 


CO 

5o 


1 


3 


01010001011 


5y 


3 


7 


01010100001 


60 


6 


5 


01010100011 


61 


5 


6 


01010101001 


62 


7 


4 


01010101011 


63 


4 


7 


0000000000001 


64 


8 


3 


000000000001 1 


65 


3 


8 


0000000001001 


66 


7 


5 


0000000001011 


67 


8 


4 


0000000100001 


68 


5 


7 


0000000100011 


69 


4 


8 


0000000101001 


70 


6 


6 


0000000101011 


71 


7 


6 


0000010000001 ' 


79 


c 


Q 

o 


UU0001 0000011 


73 


8 


5 


0000010001001 


74 


6 


7 


0000010001011 


75 


8 


6 


0000010100001 . 


76 


7 


7 


0000010100011 
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Code No 


ProhO 

X 1UUU 




v^uiivworci 


77 


6 


8 


0000010101001 


78 


8 


7 


0000010101011 


79 


7 


8 


0001000000001 


80 


8 


8 


0001000000011 



Table 2 



With the nine prediction modes (Table 1) and the probabilities of the modes 
(Table 1, Table 2), a mode selection algorithm determines the mode according to 
which a particular subblock is predicted. In one embodiment of the present 
invention, the algorithm selects the mode using a sum of absolute differences (SAD) 
between the pixels a-p and the corresponding pixels in the original frame, and the 
above probabilities of the modes. The SAD and the probability table are used to 
select the mode for a particular subblock 38. The algorithm calculates a parameter 
uError for each of the nine possible modes Mode 0-8. The mode that provides the 
smallest uError is the mode selected for the subblock 38. 

The uError is calculated as follows: 

uError = SAD({a,...,p},{original frame}) + rd_quant[uMBQP] * uProb, 

where SAD({a,...,p},{original frame} is the sum of absolute difference between 
the pixels a-p and the corresponding pixels in the original frame, 

where rd_quant[uMBQP] is a table of constant values indexed by a 
quantization parameter uMBQP. uMBQP is given by 

const U8 rd_quant[32] = 

{1,1,1,1,1,1,2,2,2,2,3,3,3,4,4,5,5,6,7,7,8,9,11,12,13,15,17,19,21,24,27,30}; and 

where uProb is the probability of the mode occurring, provided by the position 
in the mode probability table (Table 1). 

For example, the prediction mode for the subblocks A is the Mode 1 and the 
prediction mode for the subblock B is the Mode 1 . The string "1 6 2 5 3 0 4 8 7" 
indicates that the Mode 1 is also the most probable mode for the subblock C. The 
Mode 6 is the second most probable mode, etc. Thus, when the algorithm calculates 
uError for the Mode 0, the probability uProb is 5. Further, for the Mode 1 the 
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probability uProb is 0, for the Mode 2 the probability uProb is 2, for the Mode 3 the 
probability uProb is 4, and so forth. 

In addition to coding the luminance portion (Y) of the video frame, the video 
system 1 of the present invention may also predict the chrominance portions (U, V) 
5 of the video frame. The chrominance portions may be considered as chrominance 
planes (U and V-planes). Typically, the chrominance planes (U and V-planes) are a 
quarter of the size of a luminance plane. Thus, in a 1 6x1 6 macroblock a 
corresponding 8x8 block of pixels exists in both the U and V-planes. These 8x8 
blocks are divided into 4x4 blocks. In general, separate prediction modes are not 

10 transmitted for chrominace blocks. Instead, the modes transmitted for the Y-plane 
blocks are used as prediction modes for the U and V-plane blocks. 

Figure 6 illustrates a video device incorporated with the teachings of the 
present invention, in accordance with one embodiment. As illustrated, video device 
600 includes encoder 610 and decoder 620 coupled to the inputs and outputs of the 

15 device. As described earlier, encoder 610 is designed to receive video frame data, 
divide the respective frame data into macroblocks and subblocks, and selectively 
intracode the subblocks as earlier described. Decoder 620 is designed to receive 
the intracoded subblocks and recover the video frame data as earlier described. 
Encoder 610 and decoder 620 are similarly constituted as the earlier 

20 described encoder apparatus 1 and decoder apparatus 5. In various embodiments, 
encoder 610 and decoder 620 may share at least in part their constituting tables and 
coding/decoding logics (as denoted by the intersecting blocks of encoder 610 and 
decoder 620). 

In various embodiments, video device 600 may be a wireless mobile phone, a 
25 palm sized computing device, such as a personal digital assistant, a laptop 
computing device, a desktop computing device, a server, and other computing 
devices of the like. In other embodiments, video device 600 may be a circuit board 
component, such as a video "add-on" circuit board (also referred to as a daughter 
circuit board), a motherboard, and other circuit boards of the like. 
30 In yet other embodiments, instead of having both encoder 610 and decoder 

620, video device 600 may include encoder 610 only, as in the case of a video 



-23- 



WO 2004/006587 



PC17US2003/018963 



camera, or decoder 620 only, as in the case of a DVD player, a television, a display 
monitor, or a set-top box. 

Figure 7 illustrates an article of manufacture including a recordable medium 
700 having programming instructions implementing a software embodiment of the 
5 earlier described encoder apparatus 1 and/or decoder apparatus 5. The 

programming instructions are designed for use to program video device 710 to equip 
video device 710 with the encoding and decoding capabilities of the present 
invention. 

For the embodiment, video device 710 include storage medium 712 to store at 
10 least a portion of a working copying of the programming instructions implementing 
the software embodiment of encoder apparatus 1 and/or decoder 5, and at least one 
processor 714 coupled to storage medium 712 to execute the programming 
instructions. 

Video device 712 may be any one of the earlier enumerated example device 

15 devices or other video devices of the like. Article 710 may e.g. be a diskette, a 

compact disk (CD), a DVD or other computer readable medium of the like. In other 
embodiments, article 710 may be a distribution server distributing encoder apparatus 
1 and/or decoder apparatus 5 on line, via private and/or public networks, such as the 
Internet. In one embodiment, article 710 is a web server. 

20 Figure 8 illustrates an example system having video sender 802 and video 

receiver 804 communicatively coupled to each other as shown, with video sender 
802 encoding a video in accordance with the teachings of the present invention, and 
providing the encoded video to video receiver 802, and video receiver 802, in turn 
decoding the encoded video to render the video. Video sender 802 and video 

25 receiver 804 are equipped with the earlier described encoder apparatus 1 and 
decoder apparatus 5 respectively. 

An example of video sender 802 is a video server, whereas an example of a 
video receiver 804 is a client device coupled to video sender 802. 

In various alternate embodiments, encoding for Modes 4 and 6 are 

30 streamlined to employ only the pixels of the adjacent subblocks above the subblock 
being encoded in predicting the pixel values of the subblock being encoded. More 



-24« 



WO 2004/006587 PCT/US2003/0 18963 



specifically, the pixel values of the subblock being encoded are predicted under 
modes 4 and 6 as follows: 
Streamlined Mode 4 





a 




(A 


+ 


O * "D 


+ C + 2) 


/ 


4 ; 




b, e 




(B 


+ 




+ D + 2 ; 


/ 


4; 




c, f , i 




(C 


+ 


2 *D 


I T—1 , #-» \ 

+ E + 2) 


/ 


4; 




d,g, j ,m 




(D 


+ 


r-» j. t— i 

2 *E 


+ F + 2) 


/ 


4; 




h, k, n 




(E 


+ 


z n r 


+ G + 2; 


/ 
/ 


4; 




l,o 




(F 


+ 


2 *G 


+ H + 2; 


/ 


4; 


10 


P 




(G 


+ 




+ 2) / 4 








Streamlined Mode 6 












a 




(A 


+ 


B + 


1) / 2; 








b,i 




(B 


+ 


c + 


1) / 2 ; 








C/ j 




(C 


+ 


D + 


1) / 2; 






15 


d,k 




(D 


+ 


E + 


1) / 2; 








1 




(E 


+ 


F + 


1) / 2; 








e 




(A 


+ 


2*B 


+ C + 2) 


/ 


4; 




f , m 




(B 


+ 


2*C 


+ D + 2) 


/ 


4; 




g,n 




(C 


+ 


2*D 


+ E + 2) 


/ 


4; 


20 


h, o 




(D 


+ 


2*E 


+ F + 2) 


/ 


4; 




P 




(E 


+ 


2*F 


+ G + 2) 


/ 


4; 



Further, encoding for Mode 7 is streamlined to employ only the pixels of the 
adjacent subblock to the left of the subblock being encoded in predicting the pixel 
values of the subblock being encoded. More specifically, the pixel values of the 
25 subblock being encoded are predicted as follows: 

Streamlined Mode 7 

a - (I + J + 1) / 2; 

b = (I + 2*J + K + 2) / 4; 

c,e = (J + K + 1) / 2; 

30 d,f = (J + 2*K + L + 2) / 4; 

g,i = (K + L + 1) / 2; . 



-25- 



WO 2004/006587 PCT/US2003/018963 



h,j a (K + 2*L + L + 2) / 4; 

l,n,k, 

m, o,p = L; 

In yet other embodiments, a macroblock may be subdivided into MxN 
5 subblocks where MxN may be 8x8, 8x4 or 4x8 instead. For the purpose of this 
portion of the description, as illustrated in Figures 9a-9c, a pixel of a MxN subblock 
shall be referred to as py, where the index i denotes a row position of the subblock 
and may assume a value of i through 8 in the cases of 8x8 and 8x4 subblocks or 1 
through 4 in the case of 4x8 subblocks, and the index j denotes a column position of 
1 0 the subblock and may likewise assume a value of 1 through 8 in the cases of 8x8 
and 4x8 subblocks or 1 through 4 in the case of 8x4 subblocks. 

As illustrated, the predictor pixels of the adjacent subblocks above the 
subblock being encoded are referred to as to through ti 5l and the predictor pixels of 
the adjacent subblocks to the left of the subblock being encoded are referred to as 1 0 
15 through li 5 . 

For Modes 0-2, pixel values of a MxN subblock, whether MxN is 8x8, 8x4, or 
4x8, are predicted as follows: 

ModeO 

Where to - t N and lo - 1m are available, 

20 

Pij = (to + ••• + tN + lo + ••• + 1m + N/2 + M/2) / (M + N) ; 

Else if only t 0 - t N are available, 

Pij - (t 0 + ... + t N + N/2) / N; 

Else if only 1 0 - 1m are available, 

Pij = do + .» + 1m + M/2) / M; 
25 Else 

Pij = 12 8; 

i = 0-(N-l),j = 0-(M-l). 

Mode 1 

Where to - t N are available 

30 Py = tj; 
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i = 0-(N-l),j = 0-(M-l). 

Mode 2 

Where 10 - IN are available 
Pij = li; 

i = 0-(N-1),j = 0-(M-1). 
For Modes 3 - 8, a pixel value of a MxN subblock is predicted as follows: 



Mode 3 

Where all to - t N and 1 0 - 1 M are available for prediction 



4x8 subblock 


8x4 subblock 


8x8 subblock 


predicted by 


- 


P07 


P07 


( t s + t 6 «l + t 7 + 2 ) » 2 


- 


Pos* P17 


P06 / Pl7 


( t 4 + t 5 «l + t 6 + 2 ) » 2 


- 


P05, Pie/ P27 


P05# Pl6/ P27 


( t 3 + t 4 «l + t 5 + 2 ) » 2 




P04, Pl5/ P26# P37 


P04, Pl5/ P26f P37 


( t 2 + t 3 «l + t 4 + 2 ) » 2 


P03 


Po 3 , Pl4» P25# P36 


P03* Pl4, P25# P36# P47 


( t x + t 2 <<l + t 3 + 2 ) » 2 


P02 / Pl3 


p02, Pl3, P24, P3S 


P02, Pl3# P24, P35/ P46, 
PS7 


( t 0 + ti«l + t 2 + 2 ) » 2 


P01 1 Pl2 , P23 


POX/ Pl2# P23/ P34 


P01» Pl2, p23, P34, / 
P45f PS6, P67 


( q + t 0 «l + ti + 2 ) » 2 


P00/ Pll, P22/ p33 


Poo / Pll , P22 / P33 


P0O» Pll/ P22/ p33/ 
P44/ P55/ PSG* P77 


( 1 0 + q«l + t 0 + 2 ) » 2 


PlO, P21, p32/ P43 


PlO/ P21/ P32 


Pl0# P21, P32. / P43/ 
PS4# P6S/ P76 


( li + lo«l + q + 2 ) » 2 


P20/ P31, P42/ P53 


P20 1 P31 


P20/ P31, p42# P53* 
P64 , P75 


( 1 2 + li«l + 1 0 + 2 ) » 2 


P30r P41/ P52/ P63 


P30 


P30/ P41/ P52f P63, p74 


( 1 3 + 1 2 «1 + l x + 2 ) » 2 


P40/ P51# PS2f P73 




P40/ P51/ P62, P73 


( 1 4 + 1 3 «1 + 1 2 + 2 ) » 2 


PS0 1 P61 * P72 




P50, Pfil# P72 


( 1 5 + 1 4 «1 + 1 3 + 2 ) >> 2 


P60 * p71 




P60/ P71 


( 1 6 + 1 5 <<1 + 1 4 + 2 ) » 2 


P70 




p70 


( 1 7 + 1 6 <<1 + l s + 2 ) » 2 



Mode 4 

Where all to - t N and 1 0 - 1 M are available for prediction, 



4x8 subblock 


8x4 subblock 


8x8 subblock 


predicted by 


Poo 


Poo 


Poo 


( t 2 + ti«l + t 0 + 2 ) » 2 
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Poi / Pio 


Poi / Pio 


Poi , Pio 


( t 3 + t 2 «l + ti + 2 > » 2 


P02» Pllf P20 


P02# Pll/ p20 


P02 , Pll / P20 


( t 4 + t 3 <<! + tj + 2 ) » 2 


p03# Pl2/ p21/ P30 


P03r Pl2/ P21/ P30 


P03 1 Pl2 1 P21 / P30 


{ t 5 + t««l + t 3 + 2 ) » 2 


Pl3/ P22, P31/ P-4 0 


p04# Pl3* P22# P31 


P04, Pl3# P22/ P31# P40 


( t 6 + t s <<l + t 4 + 2 ) » 2 


P23» P32, P41* P50 


P05/ Pl4r P23# P32 


P05f Pl4* P23/ P32/ P41r P50 


( t 7 + t 6 «l + t 5 + 2 ) » 2 


P33# P42/ P51/ P60 


p06, Pl5# P24/ P33 


P06 / Pl5 / P24 , P33 * P42 / P51 / 

Peo 


( t B + t 7 «l + t 6 + 2 ) » 2 


p43 1 P92 / P61 1 p70 


p07 r Pl6/ P25 / P34 


P07 / Pl6 1 P25 / P34 / P43 * P52 / 

Psi, P?5 


( t 9 + t 8 «l + t 7 + 2 ) » 2 


PS3f P62# P71 


Pl7 > P26 r P35 


Pl7, P26/ P3S, f p44# P33 * 
P62 # P71 


( tio + t 9 «l + t B + 2 ) >> 2 


PG3/ P72 


P27 / P36 


P27, P36, P45/ P54/ PS3» P72 


( tn + ti 0 «l + t 9 + 2 ) » 2 


P73 


P37 


P37» P4S# p5S, P64# P73 


( ti2 + tn«l + tio + 2 ) » 2 






P47/ P56* P65r P74 


( tl 3 + ti2«l + tn + 2 ) » 2 






P57 / Pfifi r P75 


( ti4 + tia<<l + ti2 + 2 ) >> 2 






P67 , P76 


( tis + ti4<<l + t« + 2 ) » 2 






P77 


( ti 5 + tis<<l + t M + 2 ) » 2 



Mode 5 

Where all to - t N and 1 0 - 1m are available for prediction, then 



4x8 subblock 


8x4 subblock 


8x8 subblock 


predicted by 




P07 


P07 


( t 6 + t 7 + 1 ) » 1 




Pl7 


Pl7 


( t 5 + t 6 «l + t 7 + 2 ) >> 2 




POS/ P27 


P06 1 P27 


( t 5 + t 6 + 1 ) » 1 




Pl6 1 P37 


PlG , P37 


( t 4 + t s <<l + t 6 + 2 ) » 2 




POS * P2S 


P05 » P26 * P47 


( t 4 + t a + 1 ) » 1 




PlS/ P36 


Pl5 r P36 , PS7 


( t 3 + t 4 «l + t 5 + 2 ) >> 2 




P04 / P25 


P04# P25* P46* P67 


( t 3 + t 4 + 1 ) » 1 




Pl4 , Pas 


Pl4, P35> P56# P77 


( t 2 + t 3 <<l + t 4 + 2 ) » 2 


P03 


P03 / P24 


P03» P24/ p4S* PSS 


( t 2 + t 3 + 1 ) » 1 


P13 


Pl3/ P34 


Pl3f P34» PSS/ P76 


( t x + t 2 «l + t 3 + 2 ) » 2 


P02 , P23 


P02/ P23 


P02/ p23, P44/ P65 


( ti + t 2 + 1 ) » 1 


P12 $ P33 


Pl2/ P33 


Pl2/ P33/ P54/ P7S 


( t 0 + ti<<l + t 2 + 2 ) » 2 


POI / P22 / P43 


Poi 1 P22 


Pol* P22# p43, P64 


( t 0 + ti + 1 ) » 1 
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Pll / P32 / PS3 


Pll/ P32 


Pll/ P32/ P33/ P74 


( q + t 0 <<l + ti + 2 ) >> 2 


POO/ P21/ P42# p63 


POO/ P21 


POO/ P21# p42» Pes 


( q + t 0 + 1 ) » 1 


PlO/ P31/ p52# P73 


PlO/ P31 


PlO/ Psi, PS2/ P73 


( lo + q«l + t 0 + 2 ) » 2 


P20/ P41/ P62 


P20 


P20/ p41, P62 


( l x + 1 0 <<1 + q + 2 ) » 2 


p30/ p51/ P72 


P30 


P30 / P51 / P72 


( 1 2 + li«l + 1 0 + 2 ) » 2 


P40/ Pei 




P40 , Psi 


( 1 3 + 1 2 «1 + li + 2 ) » 2 


P50 1 P71 




P50 / P71 


( 1 4 + 1 3 «1 + 1 2 + 2 ) » 2 


Pso 




Pso 


( 1 5 + + 1 3 + 2 ) >> 2 


p70 




P70 


( 1 6 + 1 5 «1 + I4 + 2 ) » 2 



Mode 6 

Where all to - t N and 1 0 - 1 M are available for prediction 



4x8 subblock 


8x4 subblock 


8x8 subblock 


predicted by 


Poo 


Poo 


Poo 


( t 0 + ti + 1) >> 1 


PlO 


P10 


P10 


( t 0 + ti<<l + t 2 + 2 ) » 2 


P01# p20 


P01, P20 


Poi/ P20 


( ti + t 2 + 1) » 1 


Pll/ P30 


Pll 9 P30 


Pll/ P30 


( ti 4- t 2 «l + t 3 + 2 ) » 2 


P02/ P21/ p4 0 


P02 , P21 


P02 1 P21 / P40 


( t 2 + t 3 + 1) » 1 


Pl2/ P31< PSO 


P12 , P31 


P12 / P31 / Pso 


( t 2 + t 3 «l + t 4 + 2 ) » 2 


p03/ P22/ p41/ P60 


P03 / P22 


P03» p22/ P41/ PSO 


{ t 3 + t« + 1) » 1 


Pl3f P 3 2, p51/ P70 


Pl3 / P32 


Pl3/ P32/ P51/ P70 


{ t 3 + t 4 «l + t 5 + 2 ) » 2 


P23# P42/ Pfil 


P04 / P23 


P04/ p23, P42/ P61 


( t« + t 5 + 1) » 1 


P33/ p52/ P71 


Pl4 / P33 


Pl4/ P33» PS2/ P71 


( t 4 + t 5 <<l + t 6 + 2 ) » 2 


P43* P62 


POS / p24 


Po5/ P24f P43f P62 


( t 5 + t 6 + 1) » 1 


PS3 / P72 


PlS / P34 


Pl5/ P34/ PS3/ P72 


( t 5 + t 6 <<l + t 7 + 2 ) >> 2 


P«3 


P06» P2S 


P06/ P25/ P44/ P63 


( t 6 + t 7 + 1) » 1 


P73 


Pl6/ P35 


Pl6, P35f p54/ P73 


( t 6 + t 7 «l + t a + 2 ) » 2 




p07, P26 


p07/ P26/ P45r Pfi4 


( t 7 + t B + 1) » 1 




Pl7, P36 


Pl7/ p36/ PSS/ P74 


< t 7 + t a «l + t 9 + 2 )» 2 




P27 


P27f P46# PCS 


( t a + t 9 + 1) >> 1 




P37 


P37f P5S/ P75 


( t e + t 9 <<l + tio + 2 ) >> 2 






P47 , P66 


( t 9 + t xo + 1) » 1 






PS7 1 P76 


( t 9 + tio<<! + tn + 2 ) >> 2 
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P67 


( tio + tn + 1) » 1 






P77 


( tio + t u <<l + t u + 2 ) >> 2 



Mode 7 

Where all to - t N and 1 0 - 1m are available for prediction 



4x8 subblock 


8x4 subblock 


8x8 subblock 


predicted by 


Poo 


Poo 


Poo 


{ 1 0 + ll + 1 ) » 1 


Poi 


Poi 


Poi 


( 1 0 + + 1 2 + 2 ) » 2 


PlO/ P02 


P10 / P02 


PlO/ P02 


( li + 1 3 + 1 ) » 1 


Pll/ P03 


Pll / P03 


Pll, P03 


{ li + 1 2 «1 + 1 3 + 2 ) » 2 


P20 / Pl2 


p20/ Pl2/ P04 


P20r Pl2# P04 


( l a + 1 3 + 1 ) » 1 


p21 , Pl3 


P21 / Pl3 / P05 


p21/ Pl3/ POS 


( 1 2 + 1 3 «1 + I4 + 2 ) » 2 


P30, p22 


P30r P22/ Pl4/ p06 


P30, P22# Pl4/ P06 


{ 1 3 + 1 4 + 1 ) » 1 


p31/ P23 


P31r P23# Pl5* P07 


p31/ P23/ Pl5i P07 


( 1 3 + 1 4 «1 + 1 5 + 2 ) >> 2 


P40, P32 


P32 / P24 / Pl6 


P40f P32/ P24/ Pl6 


( 1« + 1 5 + 1 ) » 1 


P«ll P33 


P33 / P25 * Pl7 


P41/ P33# P2S/ Pl7 


( 1 4 + 1 5 «1 + le + 2 ) » 2 


P50# P42 


P34 , P26 


P50/ P*2/ P34/ P26 


( 1 5 + 1 6 + 1 ) » 1 


P51/ P43 


P35, P27 


p51/ P43/ P3S/ P27 


( l s + 1 6 «1 + 1 7 + 2 ) » 2 


Peo / P52 


P36 


P60/ p52# P*4/ P36 


( l s + l? + 1 ) » 1 


P61 / P53 


P37 


P61/ PS3/ P4S/ P37 


( 1 6 + 1 7 «1 + 1 7 + 2 ) » 2 


P70# P62# p71# 
P63 / P72 / P73 




P70/ P71/ P72/ P73/ 
P74/ P75/ P76/ P77/ 
Pfi2, P63/ P64/ P65/ 
P66/ P67/ p54/ P55/ 
P56/ P57/ P4€/ P47 


I7 



Mode 8 

Where all to - t N and 1 0 - 1m are available for prediction, then 



4x8 subblock 


8x4 subblock 


8x8 subblock 


predicted by 




P07 


P07 


( t« + t 5 «l + t 6 + 2 ) » 2 




Poe 


pos 


( t 3 + t 4 <<l + t s + 2 ) » 2 




Pos / Pl7 


P05, Pl7 


< t 2 + t 3 <<l + t 4 + 2 ) » 2 




P04 / Pie 


P04 / Pie 


( t x + t 3 <<l + t 3 + 2 ) >> 2 


P03 


P03/ Pl5/ P27 


P03 / Pl5 / P27 


( t 0 + ti<<l + t 3 + 2 ) » 2 
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V 02 


P02 / Pl4 / p26 


P02 1 Pl4 * P26 


( or 4, t**<«1_ a f-i 4. 0 \ "> > 2 


Pol t Pl3 


Pol r Pl3 » p2S t p37 


Pol 1 Pl3 » P25* p37 


f 1* + rT^<-T_ a t-y» A 5 } *> 3, O 


POO t Pl2 


POO r Pl2 / p24 1 p36 


POO t Pl2 r p24 / P36 


( fr 1 1 _ 4. 1 N 1 


PlO i P22 


PlO# P22# P34 


PlO» P22» P34 f P46 


V AO • 11 » X/ X 


Pll / P23 


Pll t P23 1 P3S 


Pll» P23* P3S» P47 


f rt x 1 x 1 1 ~i \ ^ ^ 0 
I 4 T Xq<<X T Xx ~T 6 ) >> z 


P20 / P32 


P20 # P32 


P20/ P32# p44# P56 


V ±1 f X2 • J-) >> X 


P21 / P33 


P21# P33 


P21/ P33/ p4S# P57 


V Xq t lissl f X2 • ^ / ^ 


p30/ P42 


P30 


P30f p42/ p54/ p66 


V T A 5 . X/ -> _> _L 


P3X# P«3 


P31 


P31 / P43 # PSS / P67 


\ Xl • T X3 T A | >> Z 


P40 / P52 




P40/ PS2* P64 / p76 


V X3 f X4 t x; x 


p41/ P53 




P41# p53* P65/ P77 


V A2 + X3<<X T i.4 ~r *Z / >> 4 


PS0» P62 




PSO / P62 / P74 


( I4 + lg + 1) >> 1 


p51/ P63 




PSI, Pfi3, P75 


( 1 3 + + 1 5 + 2 ) » 2 


P60# P72 




P60/ P72 


( l s + 1 6 + 1) » 1 


P61 1 P73 




P61 / P73 


( 1 4 + 1 5 «1 + 1 6 + 2 ) » 2 


p70 




P70 


( 1« + 1 7 + 1) » 1 


P71 




P71 


< 1 5 + 1 6 «1 + 1 7 + 2 ) >> 2 



Conclusion and Epilogue 



Thus, it can be seen from the above descriptions, a novel method for 
intracoding and decoding video frame data, including encoders, decoders, devices 
and systems incorporated with the method have been described. 
5 While the present invention has been described in terms of the foregoing 

embodiments and example applications, those skilled in the art will recognize that 
the invention is not limited to the embodiments and example application described. 
The present invention can be practiced with modification and alteration within the 
spirit and scope of the appended claims. In particular, some or all of the present 
10 invention (e.g. the various operational logic) may be implemented in Application 
Specific Integrated Circuits (ASIC). 

Thus, the description is to be regarded as illustrative instead of restrictive on 
the present invention. 
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